User interaction event data capturing system for use with aerial spherical imagery

ABSTRACT

A data capturing system for use with aerial spherical imagery is provided. The system allows for capturing and tracking of data with respect to those accessing and viewing particular aerial spherical imagery, such as the imagery on a GIS map. The data capturing system may include a server having a processor and a memory and a software application providing instruction to the server to display aerial spherical imagery, such as spherical imagery, to a user through a network connection, such as through the Internet. For example the system may provide the map as a web site to the user that is displayed on a remote computing device accessible by the user in order to view the spherical imagery. Data related to the interaction of the user with the website is captured and tracked in order to use such data for other purposes.

CROSS REFERENCE TO RELATED APPLICATION[S]

This application is a continuation of U.S. patent application entitled“USER INTERACTION EVENT DATA CAPTURING SYSTEM FOR USE WITH AERIALSPHERICAL IMAGERY,” Ser. No. 15/059,051, filed Mar. 2, 2016, whichclaims priority to U.S. Provisional Patent Application entitled “USERINTERACTION EVENT DATA CAPTURING SYSTEM FOR USE WITH AERIAL SPHERICALIMAGERY,” Ser. No. 62/126,913, filed Mar. 2, 2015, the disclosure ofwhich is hereby incorporated entirely herein by reference.

BACKGROUND OF THE INVENTION Technical Field

This invention relates generally to a data capturing system and moreparticularly to a data capturing system for use with aerial sphericalimagery.

State of the Art

Aerial photography is useful for many different purposes. For example,aerial photography is used for cartography, land-use planning,archaeology, movie production, environmental studies, surveillance,commercial advertising, conveyancing, artistic projects, and many otherpurposes. The imagery that is captured is often used with a geographicinformation system (“GIS”) to provide additional information.

Various business and entities are utilizing aerial spherical imagery inorder to market and provide better service to customers and the like byusing GIS maps and the like. However, a system of capturing data ofthose accessing such aerial spherical imagery and tracking the data forspecific purposes does not exist.

Accordingly, there is a need for a data capturing system for use withaerial spherical imagery.

SUMMARY OF THE INVENTION

The present invention relates to a data capturing system for use withaerial spherical imagery. The system allows for capturing and trackingof data with respect to those accessing and viewing particular aerialspherical imagery, such as the imagery on a GIS map.

An embodiment of a data capturing system for use with aerial sphericalimagery includes a server having a processor and a memory and a softwareapplication providing instruction to the server to display aerialspherical imagery, such as spherical imagery, to a user through anetwork connection, such as through the Internet. The system includes aremote computing device accessible by the user in order to view thespherical imagery. The server further includes instructions to captureany geographic data, time data, zoom level and the like associated witha user accessing the spherical imagery through the network connection.The data is captured and stored in memory on the server in a databasethat is searchable and may be manipulated by other software applicationsto utilize such collected data.

An embodiment includes a user interaction event data capturing systemfor use with aerial spherical imagery, the system comprising: a servercomprising a memory, a database stored in the memory, and a processor,wherein the database contains data for a spherical image and data for areference map; and a computer coupled to the server wherein a userinterfaces with the server through the computer, wherein the server isprogrammed to: automatically display at the computer a georectifiedspherical image sent from the server; automatically receive at theserver data of the user interaction with the spherical imagecommunicated from the computer, wherein the data of the user includes ageorectified point of interest; automatically store the data of the userin the database of the server.

The server may be further programmed to automatically receive at theserver data of the user interaction with the spherical imagecommunicated from the computer, wherein the data of the user includesdwell time at the georectified point of interest; automatically receiveat the server data of the user interaction with the spherical imagecommunicated from the computer, wherein the data of the user includes aplurality of georectified points of interest; automatically receive atthe server data of the user interaction with the spherical imagecommunicated from the computer, wherein the data of the user includes adwell time at each of the plurality of georectified points of interest;to automatically receive at the server data of the user interaction withthe spherical image communicated from the computer, wherein the data ofthe user includes an order of viewing each of the plurality ofgeorectified points of interest; to automatically receive at the serverdata of the user interaction with the spherical image communicated fromthe computer, wherein the data of the user includes at least one zoomlevel of viewing the georectified point of interest; to automaticallyreceive at the server data of the user interaction with the sphericalimage communicated from the computer, wherein the data of the userincludes data regarding jumping to at least one neighboring sphericalimage.

Another embodiment includes a method of using a post capture imageryprocessing system to georectify an aerial spherical image, the methodcomprising: storing data for a spherical image and data for a referencemap in a database of a server comprising a memory and a processor,wherein the database is stored in the memory; coupling the server to acomputer, wherein a user interfaces with the server through thecomputer; automatically displaying at the computer a georectifiedspherical image sent from the server; automatically receiving at theserver data of the user interaction with the spherical imagecommunicated from the computer, wherein the data of the user includes ageorectified point of interest; and automatically storing the data ofthe user in the database of the server.

The method may further comprise automatically receiving at the serverdata of the user interaction with the spherical image communicated fromthe computer, wherein the data of the user includes dwell time at thegeorectified point of interest; automatically receiving at the serverdata of the user interaction with the spherical image communicated fromthe computer, wherein the data of the user includes a plurality ofgeorectified points of interest; automatically receiving at the serverdata of the user interaction with the spherical image communicated fromthe computer, wherein the data of the user includes a dwell time at eachof the plurality of georectified points of interest; automaticallyreceiving at the server data of the user interaction with the sphericalimage communicated from the computer, wherein the data of the userincludes an order of viewing each of the plurality of georectifiedpoints of interest; automatically receiving at the server data of theuser interaction with the spherical image communicated from thecomputer, wherein the data of the user includes at least one zoom levelof viewing the georectified point of interest; and automaticallyreceiving at the server data of the user interaction with the sphericalimage communicated from the computer, wherein the data of the userincludes data regarding jumping to at least one neighboring sphericalimage.

The foregoing and other features and advantages of the present inventionwill be apparent from the following more detailed description of theparticular embodiments of the invention, as illustrated in theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete understanding of the present invention may be derived byreferring to the detailed description and claims when considered inconnection with the FIGURES, wherein like reference numbers refer tosimilar items throughout the FIGURES, and:

FIG. 1 is a diagrammatic view of a system for capturing user interactionevent data, in accordance with an embodiment of the invention.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION

As discussed above, embodiments of the present invention relate to adata capturing system for use with aerial spherical imagery. The systemallows for capturing and tracking of data with respect to thoseaccessing and viewing particular aerial spherical imagery, such as theimagery on a GIS map.

The data capturing system may include a server having a processor and amemory and a software application providing instruction to the server todisplay aerial spherical imagery, such as spherical imagery, to a userthrough a network connection, such as through the Internet. For examplethe system may provide the map as a website to the user that isdisplayed on a remote computing device accessible by the user in orderto view the spherical imagery.

Access of the spherical imagery on a remote computing device establishesa communication link between the remote computing device and the server.The software application operating on the server to display thespherical imagery further includes instructions to capture anygeographic data, time data, zoom level and the like associated with auser accessing the spherical imagery through the network connection. Thedata is captured and stored in memory on the server in a database thatis searchable and may be manipulated by other software applications toutilize such collected data.

For example, the data collected may include what is being looked at,geo-references associated with the displayed image, the zoom level, thetime it was accessed and additional movement and interactions with thesystem, including any search terms, resulting image displayed inresponse to entering the search terms.

This image allows for the determining of any area of interest and can beutilized in other applications. For example, if the user is accessingsuch a system as part of searching for a home to buy, the data capturedmay be utilized by the system to provide advertisement or additionalhouse listings to the person accessing the system. Or, a user can accessthe system in search of where a particular restaurant or retail store islocated. The system may collect data and direct specific advertising tothe user based on the collected geographical data and the other datacollected from the spherical imagery. Such data may also be utilized inmilitary applications.

In essence, embodiments of the present invention allow a system tocollect data from a user of the system, wherein the data include havingpoints selected by the user and paths viewed by the user georectified.Further the present invention allows the capturing the path, order anddwell time for a starting sphere and moving to neighboring spheresincluding the dwell time in the neighboring spheres.

Referring to FIG. 1, depicted is a diagrammatic view of the system 10that allows for capture of user interaction events and data. When theuser is looking at a region within the spherical image or current sphere50 having a center C in a deployment interface, including viewer 12, thesystem 10 captures data related to the viewing frustum defined by thepyramid 14 or field of view, by taking average foveal focus capacity ofhuman beings to narrow down the focus area within this pyramid 14, thezoom level or angle θ, and if the user clicks the point of interest P.We can geo rectify using our reverse warp process to then accuratelyproject the perceived point/area of interest. We can also take pointsalong the path travelled by the user/viewer and create a navigationalhistory that is georectified. The capture of the path data may include asimple formula of path data=Path+td, wherein td is the dwell time ortime the user spends at a location. This calculation describes variousplaces the user looked and in what order, and if the user jumped toneighboring spheres, such as, but not limited to neighboring spheres S1,S2, S3 and so forth. Further jumps to other spheres and total pathtravelled being captured has not been previously tracked. Particularlywhen that information is georectified in order to accurately determinewhat particular places, buildings, stores and the like the user waslooking at, dwelling on and the like.

The embodiments and examples set forth herein were presented in order tobest explain the present invention and its practical application and tothereby enable those of ordinary skill in the art to make and use theinvention. However, those of ordinary skill in the art will recognizethat the foregoing description and examples have been presented for thepurposes of illustration and example only. The description as set forthis not intended to be exhaustive or to limit the invention to theprecise form disclosed. Many modifications and variations are possiblein light of the teachings above without departing from the spirit andscope of the forthcoming claims.

The invention claimed is:
 1. A user interaction event data capturingsystem for use with aerial spherical imagery, the system comprising: aserver comprising a memory, a database stored in the memory, and aprocessor, wherein the database contains data for a spherical image anddata for a reference map; and a computer coupled to the server wherein auser interfaces with the server through the computer, wherein the serveris programmed to: automatically display at the computer a georectifiedspherical image sent from the server; automatically receive at theserver data of the user interaction with the spherical imagecommunicated from the computer, wherein the data of the user includes aplurality of georectified points of interest; automatically store andtrack the data of the user in the database of the server; and analyzethe plurality of georectified points of interest along a path travelledby the user and create a navigational history that is georectified. 2.The system of claim 1, wherein the server is further programmed toautomatically receive at the server data of the user interaction withthe spherical image communicated from the computer, wherein the data ofthe user includes dwell time at the plurality of georectified points ofinterest.
 3. The system of claim 2, wherein the server is furtherprogrammed to automatically receive at the server data of the userinteraction with the spherical image communicated from the computer,wherein the data of the user includes a dwell time at each of theplurality of georectified points of interest.
 4. The system of claim 3,wherein the server is further programmed to automatically receive at theserver data of the user interaction with the spherical imagecommunicated from the computer, wherein the data of the user includes anorder of viewing each of the plurality of georectified points ofinterest.